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Factors Contributing To Job Failure Among Shipboard 
Independent Duty Hospital Corpsmen 
SDNMARY 

The two objectives of this study were (a) to determine both the prevalence and 
causes of job failure among Navy shipboard independent duty technician (IDT) 
corpsmen, and (b) to identify possible methods to prevent or reduce IDT job failure. 
Data extracted from service records were analyzed for a sample of 58 controls and 37 
IDT corpsmen job failures. Job failures were nominated by NMPC, EPMAC, and Force 
Medical Departments. The records of any corpsman on any list was reviewed for 
possible study inclusion. 

The prevalence of job failures among Fleet IDT corpsmen was based on analysis of 
personnel transfer data during 1982 and 1983. The determination of causes for job 
failure was based entirely on analysis of service record entries. Other causal 
factors are currently under study using methodology other than service record review. 

Identification of ways to prevent/reduce job failures focused on three methods: 
applicant screening, post-training job assignment, and on-the-job remedial 
assistance. Potential screening and assignment criteria were identified by 

examining four types of background data: (a) demographic characteristics, (b) 
context and type of duty assignments, (c) training background, and (d) performance 
history. The feasibility of more timely remedial technical assistance was explored 
by examining trends in performance. 
Prevalence and Causes of Job Failure 

Based on the number of verifiable performance- related reliefs during 1982 and 
1983, the prevalence of IDT job failure was estimated to be between 5 and 7% per 
year. Basic causes of performance-related relief were either inspection failures 
(38%), dishonorable conduct (32%), or problems in dealing effectively with superiors 
(30%) . Also at the actual time of job failure, performance marks emphasized both 
inflexibility and unreliability. 

The demographic backgrounds of ineffective corpsmen did not differ significantly 
from controls, nor did they differ with respect to amount of training, types or 
contexts of job experience, nor basic demographic characteristics; with one 
exception — rank. Ineffective corpsmen were more likely to be junior in rank at time 
of reporting for IDT duty, i.e., E-6 versus E-7. 
IDT Corpsman Screening 

IDT corpsman job-failures exhibited significantly more pre-application 
instances of substandard performance and fewer instances of outstanding performance 



than controls %«bo were not relieved. An instance of substandard performance was 
defined as one or more marks of 3.0 or less on any single performance evaluation. 
IDT Corpsman Assignment 

Fifty-two percent of job failures were in the bottom 25% of their graduating 
class. Currently, post-IDT job assignment takes place long before corpsmen are near 
completion of school. Therefore, unless a student becomes an academic failure, he is 
presumed to be prepared for shipboard duty. In addition, assignments are based on 
standard Navy sea/shore rotation, which results in half the IDT graduates being sent 
to shore billets. It is therefore possible, although perhaps not using current 
proceduresr to either raise standards for minimally acceptable training performance, 
or to cpiitinue currant standardsr and make shipboard assignment decisions on the 
basis of demonstrated mastery of skills during training. 
SMpboard Remedial Assistance — 

A significant 4^^i:iorating trend in performance wiis fQiiild apong ineffectriW 
corpsmeii as early as three tepoittB pribt job failure. Despite technical 
as&lstaitce having been available, many IDT ^oh failures either failed to reguest 
assistance,' or received it too la^e^^ significant performance cl#t«^©ration 

"suggests that closer supervision o£ corppmiyn pei^forii^ce could permit For^oe Medioal 
Departments to identify problems, and to intervene early enough to reduce the 
likelihood of corpsman failure. 
Recommendations 

Either screening that focuses on instances of substandard performance or 
assignment based on IDT class standing, i.e., the top three quarters of their IDT 
class would produce similar estimated reductions in the job failure rate from 5 to 
7% to about 3 to 5%. However, if practical, implementation of both pre-training 
^mr^mmmam sc^^ening and ^ssigiUBent of only top stiidemts to shipboard duty is 

Increased perfoCTance supervision of IDT c0tpsmen im the fXeei wcruld permit 
eai:ll^i: introduction of technical a^ssistance aimiia - tt pre^enti^ Ibte failures. 
Finally, E-6 IDT corpsnen fi^^Xd he eMsi^9ti0d t#: smaller units, and units that haver 
not had a recent histoiry of problems with their medical department^ 
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FACTORS CONTRIBUTING TO JOB FAILURE AMONG SHIPBOARD 
INDEPENDENT DUTY HOSPITAL CORPSMEN 

BACKGROUND 

The shipboard independent duty technician (IDT) Hospital Corpsman (HM) is at the forefront of 
Fleet health service delivery. Typically a mid-career enlisted man, the IDT corpsman serves in 
lieu of a physician aboard the majority of Fleet surface and submarine units. As the Senior Medical 
Department Representative, the IDT corpsman is primarily responsible for providing direct patient 
care to the crew. Consequently, the independent duty corpsman must possess clinical skills 
adequate to the identification and treatment of common illness and occupational injuries. Moreover, 
he must be able to determine the requirement for evacuation to a physician's care, or for post- 
treatment follow-up consultation once in port. 

Over the years, the role of the IDT corpsman has grown in scope, especially in the area of 
preventive medicine. These responsibilities include: Ensuring timely inoculations and physical 
examinations; monitoring sanitation of the ship's messing and berthing facilities; providing 
training in first aid, health, and hygiene; and monitoring and reporting on epidemiology and indus- 
trial exposure to contaminants, such as noise, heat, asbestos, and nuclear radiation. Also, the IDT 
corpsman manages his own medical supplies and equipment, he insures the material readiness of all 
the ship's stretchers, remote medical treatment sites, and first aid supply sites, and he insures 
that the entire crew is trained to cope in mass combat casualty situations. 

The role of the shipboard IDT corpsman is highly demanding, both from a clinical as well as an 
administrative perspective. Clinically, he must sometimes function with complete autonomy in making 
critical medical decisions while at sea. An incorrect medical decision might result in a board of 
inquiry to investigate malpractice. Administratively, almost every inspection of the ship and its 
readiness involves a medical component. In some cases, such as radiation health and safety, an 
inspection failure by the ship's medical department can result in the ship being taken temporarily 
out of action, or in extreme cases, even relief of the commanding officer. Consequently., the broad 
responsibilities of the IDT corpsman place him under considerable pressure. 

Recent research has reported that hospital corpsmen experience the highest incidence of stress- 
related illness in the Navy (Hoiberg, 1982). It is possible that the pressure associated with the 
autonomy and responsibility of the IDT corpsman could potentially lead to stress which might 
interfere with job effectiveness. 

The Navy places a high priority on providing its forces with the best possible health care 
(Seaton, 1983). IDT corpsmen play a critical role in the Navy's efforts to provide quality health 
care to the Navy's front-line operating forces at sea. Any time an IDT corpsman fails to meet the 
demands of his job, it reduces the Medical Department's effectiveness in providing quality health 
care to the Fleet. Therefore, it is important to explore factors associated with IDT 
ineffectiveness, and to consider methods to prevent IDT job failures. 

IDT Corpsman effectiveness can be defined in terms of job success or failure. Whenever a 
corpsman' s performance becomes ineffective to the point that he must be relieved from duty, he 
becomes a job failure. By studying IDT job failures, it is possible to obtain information that can 
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be used in the improvement of IDT personnel selection, training, and assignment. These data also 
can help to suggest ways in which to improve the Fleet health care delivery system. 

Prevalence and Causes o£ Job Failure 

A first step in an examination of job failure among IDTs is to identify specific individuals 
who experienced a job failure. Such information can be used to estimate the prevalence rate of IDT 
job failure in the Fleet. In addition, careful study of each case can permit the identification of 
major causal factors associated with job failure, as well as a determination if job failures are 
more common in the surface or submarine force, or differ as a function of Atlantic or Pacific Fleet. 
The nature of causal factors resulting in failures may also suggest areas for change. This study 
will examine several corrective methods demonstrated by previous research to be helpful in 
preventing job failure. 

Preventive Measures 

In this study, methods to prevent IDT job failures focused, whenever possible, on practical 
measures that the Navy can implement in a straightforward manner. These consist of proven methods, 
demonstrated by past research to have the potential for improved job effectiveness. These 
practical, proven methods include expansion of IDT applicant screening, modification of training 
standards and/or job assignment procedures, as well as timely remedial intervention in the Fleet by 
Force Medical Department technical assistance teams. 

Personnel Screening. Recently, Hunter and Hunter (1984) completed a statistical review of the 
job performance literature using a method known as meta analysis. Their review summarized previous 
reviews encompassing (a) 515 studies reviewed by Hunter (1980c), (b) 883 studies reviewed by 
Dunnette (1972) , (c) 103 studies reviewed by Reilly and Chao (1982) and (d) 246 studies reviewed by 
Vineberg and Joyner (1982). Hunter and Hunter's report compared the validity of most common 
predictors of job effectiveness. The Hunters concluded that, when screening personnel for jobs 
involving new, but similar duties, measures that indicated consistency of performance were most 
valid. in addition, the review by Reilly and Chao (1982) provided a variety of evidence that 
supported the predictive validity of job experience, as well as demographic background information 
for predicting both job training success and job effectiveness. The results of these comprehensive 
reviews therefore, support as potential screening criteria for the selection of IDT applicants a 
research strategy based on review and analysis of service record information such as background 
data, job experience, and performance history. 

At present, screening criteria for IDT training include an above-average general aptitude score 
(110) , a minimum rank of E-5, a minimum of six years service, and the recommendation of an 
applicant's command (Catalogue of Navy Training Courses; CANTRAC/NAVTRA 10500). Except for the 
command endorsement, assignment officers may, at their discretion, relax any of these criteria in 
order to meet future billet requirements (NAVMILPERSCOMINST 1236. IB; 25 JAN 1983). 

At the time this research was undertaken, there existed no formal review boards to assess 
factors such as disciplinary record, performance history, job experience, or training history, which 
might reflect on the suitability of applicants for the IDT job. Application materials are reviewed 
by a Chief Hospital Corpsman assigned to the Navy Military Personnel Command. Present policy 
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places the responsibility for establishing the qualifications of applicants on the endorsing 
commands; however, guidelines furnished in the Navy Enlisted Transfer Manual (NAVPERS 15909C) permit 
considerable discretion on the part of endorsing commands. 

Even without an accurate estimate of the IDT job failure rate, the Navy Military Personnel 
Command was able to confir^ that the large majority of IDT corpsmen do not undergo job failure.^ It 
seems reasonable to assume, therefore, that IDT training is adequate to ensure that most corpsmen 
are successful. Such a fact does leave open the possibility that a p!ii:cjt^atsg@ of job failures are 
due not to the quality of the training program, but are due to the quality of some of the personnel 
being trained. If the backgrounds of effective and job-failure corpsmen were found to differ 
significantly, it might be possible to reduce the number of IDT job failures by modifying the 
standards and/or procedures for screening IDT applicants. 

Personnel Training and Assignment. Because IDT certification involves a lengthy training 
period of up to 12 months, it would seem that proficiency demonstrated during training might provide 
additional information useful in predicting job effectiveness. Vineberg and Joyner (1982) published 
a lengthy review which focused exclusively on studies of military personnel job effectiveness 
conducted over the past 15 years. They concluded that training performance and aptitude each 
demonstrated the highest overall ability to predict post- training on-the-job performance evaluation 
marks. Consequently, because service records contain information regarding aptitude and training 
performance, it is possible to examine both of these variables. However, training outcomes occur 
following applicant-selection. Therefore, any significant relationship between job effectiveness 
and training achievement would require modifications in standards or procedures for either training 
or assignment rather than for personnel screening . 

According to the corpsman detailing office, the assumption is made that all IDT school 

graduates possess a minimal level of mastery of IDT job-related skills and knowledge. Currently, 

the assignment of graduates from IDT training is based on a standardized sea-shore rotation cycle 

and an attempt to match billet openings with the anticipated graduation dates, the geographic 

location, and type of ship and/or duty preferred by each corpsman. In recent years, approximately 

2 

50% of IDT graduates in the surface force pipeline (NEC 8425) have been sent to shore billets 
because, unlike their submarine force counterparts, 8425 IDT assignments must conform to the Navy's 
general sea/shore rotation policy. 

Because of the critical nature of the shipboard IDT billet, and the fact that not all IDT 
graduates are assigned shipboard duty, it would be possible to base assignments on demonstrated 
mastery (not merely acquisition) of the skills necessary to function effectively. For example, 
academic failures in IDT training are rare, and current assignment policy does not take classroom 
proficiency into account. If a relationship between job failure and cla'ss standing were found to 
exist, then the Navy would be justified either in basing shipboard assignments on mastery of 
skills, as demonstrated by class standing, or in holding students to a higher standard of knowledge 
and skill mastery to qualify for an IDT NEC. 

Technical Assistance. Some job failures might be prevented from occurring after corpsmen 
report for duty in the fleet. This would only be possible if some form of remedial intervention 
could be introduced before performance reached unacceptable levels. Current Force Medical 
Department on-the-job assistance is initiated either at the request of a ship (By the command or 



the corpsman) or as a consequence of a periodic inspection failure. According to interviews with 
Surface and Submarine Medical Force Master Chiefs, most technical assistance visits occur following 
an inspection failure. The Master Chiefs also indicated that once an inspection failure has 
occurred, it is often too late to prevent a job failure. The effectiveness of technical assistance 
may be improved through more timely identification of problems, thereby permitting earlier 
introduction of preventive measures. 

In order to determine whether earlier introduction of intervention is feasible, it would be 
necessary to determine whether job failure is a gradual process or a sudden, abrupt breakdown. If 
failures are precipitated by a detectable deterioration in performance, then increased monitoring 
for the signs of deteriorating performance would permit Force Medical Departments to initiate 
appropriate action in time to prevent job failures. If, on the other hand, job failures occur 
suddenly, then an impending job failure would not be signaled by deteriorating performance, and 
timely remedial assistance would not be feasible. The type of technical assistance appropriate for 
preventing job failure can be inferred, to some extent, from the causal factors associated with IDT 
job failures. 

Summary of Objectives 

The study had four objectives. The initial objective was to estimate the prevalence of IDT job 
failure in the Fleet, and to classify the principal reasons job failures occur. The remaining 
three objectives focused on the identification of possible methods for the prevention or reduction 
of job failure among Fleet IDT corpsmen. Specifically, the second objective was to examine 
background differences between effective and job-failure IDT corpsmen in order to identify any 
variables which could predict potential job failures. The third objective was to examine the 
relationship between job failure and IDT class standing in order to determine whether shipboard 
assignments should be restricted to top IDT trainees either through academic or personnel action. 
The fourth objective was to analyze performance trends preceding relief from duty in order to 
determine whether it would be possible to identify a potential job failure sufficiently early to 
prevent it through remedial assistance. 

METHODS 

The approach used in this research was archival. That is, data were derived primarily from the 
service record entries in personnel files maintained at the Navy Military Personnel Command (NMPC) 
in Washington. Target subjects consisted of all independent duty hospital corpsmen who underwent a 
job failure (performance-related relief from shipboard duty) during a target two-year period 
between January 1982 and December 1983, inclusive. 

This two-year period was selected primarily for two reasons. First, because it is desirable to 
be able generalize results to the current situation in the Fleet, going back more than a few years 
might result in an invalid representation of factors affecting IDT job failures. Second, record 
data on performance-related reliefs prior to 1982 was unreliable primarily due to spotty 
availability. 

It must be noted that information derived from service record entries is limited in 
application. The most valid use of such information is to address personnel screening and assign- 
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ment issues (Allport, 1942; Dunnette, 1962; Harding & Bottenberg, 1962; Owens & Henry, 1966; Owens 
1976). Record entries cannot, for example, reflect adequately an individual's work environment, 
the adequacy of shore support, quality of training, ship's operational readiness, usefulness and 
appropriateness of inspections and drills, and a host o£ other factors that can impact on the 
performance and effectiveness of a corpsman. Other approaches are required to address such issues, 
and separate reports will consider IDT corpsman performance and effectiveness based on data 
appropriate to such questions. 

Subjects 

Deriving a valid list of IDT corpsman job-failures was not straightforward. One reason was 
that the Navy does not maintain a centralized ongoing list of the individuals who have been relieved 
for performance-related causes. Obtaining a valid list of IDT job failures was further complicated 
because the Navy makes a distinction between a "relief for cause" and an unprogramraed relief due to 
unacceptable performance. A "relief for cause" is a job failure that has been formally determined 
by the Enlisted Personnel Quality Review Board at NMPC. An unprogrammed relief, on the other hand, 
is any relief of a corpsman earlier than his normal projected rotation date (a period extending 
about three years from date of reporting aboard) • However, unprogrammed reliefs can occur for a 
variety of reasons that may have nothing to do with unacceptable performance. Unprogrammed reliefs 
can include humanitarian transfers, transfers to attend officer candidate training, or to attend 
physician's assistant training, transfers due to illness or injury, as well as performance-related 
transfers . 

Although relief for cause involves action by a formal review board, performance-related relief 
merely involves a ship*s commanding officer requesting a replacement based on dissatisfaction with a 
corpsman *s performance. If a command fails to follow up a performance-related relief by providing 
required supporting information, a formal determination by NMPC of "relief for cause" cannot be 
made. 

Therefore, defining the study sample on the basis of a "relief for cause" designation seemed 
overly restrictive, because it could exclude many job failures on the basis of an administrative 

technicality. On the other hand, defining the sample as all unprogrammed reliefs would have 
included numerous cases that represented nonper f ormance-related factors, or actually signified 
outstanding performance (as in the case of officer or physician's assistant training). 
Consequently, lists of corpsmen relieved from duty prematurely for performance-related reasons were 
solicited from each of the Medical Administrative Departments of the four Force Commanders who 
initiate IDT relief actions (SURFPAC, SURFLANT, SUBPAC, and SUBLANT) . Fleet information was cross- 
referenced with additional lists obtained from NMPC and the Enlisted Personnel Manpower Analysis 
Center (EPMAC) • 

The service records were drawn on any individual designated on any list as a performance- 
related relief. Final determination of performance-related relief cases was based on the criterion 
that the IDT corpsman was (a) relieved prematurely from shipboard duty, and (b) given a failing 
general performance mark of 2.8 or lower at the time of transfer from duty. 

The initial pool of subjects consisted of 82 relieved IDT corpsmen. A total of 32 were 
excluded from this study because they were, in fact, reliefs for medical, humanitarian, or other 
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reasons which did not meet the two criteria stated in the previous paragraph. Also, some relief- 
£or-cause cases were excluded. These included five corpsmen whose relief from IDT duty was related 
entirely to voluntary enrollment into substance abuse treatment with no evidence of significant 
performance decrement. One IDT corpsman was excluded because the relief context was not a ship. An 
additional 7 corpsmen were excluded because record data did not reflect a performance-related 
relief, although they had been designated as job failures by Force Medical Departments. Two of the 
7 lacked a detaching performance evaluation or any other documentation reflecting, for the record, 
the circumstances surrounding the relief action. All the above cases were excluded primarily 
because it was desirable to confine analyses, as much as possible, to information typically 
available in NMPC personnel files, which are currently used to screen applicants. The final sample 
of job-failure corpsmen consisted of 37 IDTs who had served aboard ship for at least one reporting 
period prior to their performance-related relief from duty during 1982 or 1983. 

In addition to the sample of job-failure corpsmen, a control sample was drawn by MMPC 
assignment officers. This group consisted of a sample of 15 IDT corpsmen from both the Surface and 
Submarine Forces in the Atlantic and Pacific Fleets. These corpsmen had served aboard ship during 
the period 1982 and 1983, but had either undergone a "due course** relief (i.e., regular end of tour 
rotation) or were still serving successfully as shipboard IDTs as of November 1983. In order to 
meet minimum constraints for valid statistical inferences, a minimum of 12 subjects per force was 
required to validly test for any differences caused solely by fleet or force differences (Cohen, 
1977) • Two subjects were excluded because of incomplete performance records which could not be re- 
placed in a timely manner. The final control sample consisted of 58 subjects, 14 to 15 per force 
in each Fleet. 

Table 1 presents a demographic breakdown of the backgrounds of the job-failure group compared 
to the control group. As can be seen, the only variable on which the two groups significantly 
differed was rank. The significant difference in rank between the job^failure and control groups, 

warranted an analysis of the possibility of sampling bias in selecting control subjects. This 
analysis compared the sample of controls to the distribution of rank among shipboard IDTs in the 
Fleet. A previous study, conducted by NHRC (Nice, 1984) provided a distribution of the pay grades 
of IDTs in the Fleet during the 1982-1983 time frame. Table 2 demonstrates that the current 
control group did not differ significantly on the basis of rank when viewed from a fleet-wide 
perspective. Therefore, it was concluded that the control group was representative of the Fleet. 
The implications of the rank difference between job failures and controls will be addressed in the 
results section of this paper. 

Table 3 lists the major variables coded and examined in this research. Some variables 
considered for inclusion were omitted from further analysis due to difficulties in validly coding 
data, evidence of data unreliability, or lack of sufficient variance to permit valid inferences. 
Most of these variables are listed in Appendix A. Variables included in the present research can be 
divided into seven categories: demographic characteristics, job training, performance history, job 
experience, qualitative factors (e.g., reason for relief, prior health problem), and pre-relief IDT 
job performance marks. 
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Table 1 

Backgr ounds of Job Failures and Effective (Controls) Shi pboard 
Independent Duty Corpsmen Sa mpled fo r 1982 and 1983 



Job Failures Controls Job Failures Controls 



Race: 






Dependents : 






White 
Black 
Other 


80% 
13% 
7% 


90% 
5% 
5% 


None 
1 
2 
3 

4+ 


13% 
21% 
18% 
29% 
21% 


7% 

29% 
22% 
22% 
20% 


Marital Status: 




Prlnary NEC: 






Married 

Divorced 
Single 


68% 

16% 
16% 


84% 

9% 
7% 


8402 

8424 
8425 


28% 

3% 
69% 


48% 

4% 
48% 


Basic Training: 




"C" School Training: 




S. Diego 
G. Lakes 
Orlando 
Other 


36% 
49% 
13% 
3% 


52% 
38% 

9% 
2% 


None 

1 Other 

2 Others 

3 Others 


32% 
43% 
24% 
0% 


24% 
48% 
• 24% 
3% 


Corpsman Training: 




IDT Training 






Months 

9-12 
12-18 
18-24 
24-30 
30+ 


3% 
60% 
15% 

10% 
13% 


8% 
40% 
35% 

10% 
7% 


S. Diego 

Portsmth, 

Groton 

Other 


39% 

41% 
21% 
0% 


35% 

31% 
29% 
5% 


Age During 


IDT Tour: 




Aptitude (GCT/ARI or 


ASVAB): 


Under 35 
35 to 40 
40+ 


79% 
16% 
5% 


66% 
30% 
4% 


Under 110 
110 + 


24% 
.75% 


22% 
78% 


Rank: 






Pre-IDT-Tour 


Time in 


Grade : 


HMl 
HMC 

X^(l ,N=93) 


87% 
13% 

= 21.8, p< 


40% 
60% 

.00001 


Months 
1-24 

45-45 
46+ 


39% 

33% 
28% 


30% 

34% 
36% 



Note . "Other'' categories were not included in actual computation 
to insure a minimum of 5 subjects per cell, as suggested 
bg Sie^el (1956). They are reported for information 
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Table 2 

Diff eren ces in Ra nk Betwee n Effec tive (C ont ro ls) Shipboard 
Independent Duty Corpsmen Sampled for 1982 and 1983 
Co mpared to a n IDT F leet Cen sus Conducted In 1983 



Rank Comparison fith PACFLEBT 

Rank PACFLT Controls 

HMl 52% 40% 

HMC 48% 60% 

X^(1,N=259) « 2.56, [ns] 

Rank Comparison with Surface Fleet 

Rank SURFL T Con trols 

HMl 42% 40% 

HMC 58% 60% 

X^(1,N=156) = .08, [ns] 



Note: SUBLANT did not participate In the MEDEVAC study (Nice, 
1984). Consequently the data was examined first within the 
Pacific Fleet (PACFLT), for fleet-related differences, then 
within the surface force (SURPAC/LANT) to exmaine for force- 
ralted differences. 
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Table 3 

Background Data Extracted From the Service Records of Job Failure 
and Effective Shipboard Independent Duty Corpsmen 
Sampled for 1982 and 1983 



DEMOGRAPHICS: 



JOB EXPERIENCE: 



Race 

Marital Status 
Number of Dependents 
Aptitude (GCT/ARI or equiv.) 

Rank at Time Reporting for 
Duty on Target IDT Tour 

JOB TRAINING: 

Location of Basic Training 
Number of "C" Schools Attended 
IDT-Graduate Class Standing 
Months Total HM Training 
Location of initial IDT School 

PERFORMANCE HISTORY: 

Outstanding Performance : 
Number of Navy Medals 
Number of Commendations 
Number of Honors (e.g., 
Sailor of Qtr.) 

Substandard Performance : 

Number of Pre- IDT Training Evals 
With One or More Sub- 
Standard Marks ( <_ 3.0) 

Number of Pre-IDT-Training Non- 
Judicial-Punishraents (NJPs) 
and Court Martials 



Work Context : 

Months Shipboard Duty 
Months Hospital Duty 
Months Clinic Duty 
Months School Staff Duty 
Months Field Medical Duty 

Type Duties : 

Months Clinical Experience 
Months Admin Experience 
Months Teaching Experience 
Months Lab/Tech Experience 
Months Misc Experience 

PRE-RELIEF PERFORMANCE: 

P erf orm ance Scores For P eriods ; 
Three Evals Prior to Relief 
Two Evals Prior to Relief 
One Eval Prior to Relief 
EVAL AT TIME OF RELIEF 



QUALITATIVE FACTORS: 

Reason(s) for Relief 
Administrative Ability 

Criticisms 
Medical Judgment Criticisms 
Overweight Problems 
Marital Problems 
Prior Health Problem(s) 
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Variables 

Demographics , Demographic variables not commonly related to job effectiveness were coded for 
the primary purpose of insuring that the sampling procedures used to select a control group 
(effective corpsmen) did not result in any inadvertent bias that might affect results. These 
variables are listed in Table 3. 

Training * Training background variables (Table 3) were limited to military training because 
these are most relevant to job performance and effectiveness measures (Curtis, 1971; Vineberg & 
Joyner, 1982) . Other educational accomplishment is more commonly indicative of motivation and/or 
aptitude. Class standing at graduation from IDT training was included because training achievement 
has been shown to be predictive of future job performance among senior enlisted personnel (e.g., 
Stanlee & Abrahams, 1980) . 

Performance Hi story # Performance history refers to instances of both outstanding and 
substandard performance. Performance history has been shown to relate to enlisted on-the-job 
performance and effectiveness (Vineberg & Joyner, 1983). Because outstanding performance 
evaluations of E-6 and above tend to be the rule rather than the exception (Thomas, 1968; Vineberg & 
Joyner, 1978, 1982, 1983), in the present study, outstanding performance was indicated by the number 
of awards received. Substandard performance was indicated both by disciplinary infractions 
(nonjudicial punishments and court martials) and instances of substandard periodic performance 
evaluation marks. 

Because, as was reported earlier, job effectiveness is best predicted by consistency of 
performance rather than degree, such an approach was emphasized in this study. In the case of 
outstanding performance, awards in the Navy can take many forms, ranging in importance from 
formalized congratulations (meritorious mast) to a medal for valor (e.g.. Navy Cross). No attempt 
was made to differentiate the status of awards. Each recorded instance of an award provided for an 
indicator that quantitatively would reflect the consistency of top performance, rather than the 
degree. This approach would also provide a simple, straightforward measure for use in routine 
screening procedures. Multiple occurrences of group awards (e.g., department battle efficiency "E") 
were counted only once within a single tour. 

Substandard performance is normally indicated in one of two ways: (a) formal disciplinary 
action, and (b) negative performance evaluations. As in the case for awards, disciplinary 
infractions exhibit a range of importance from being late for work, to criminally prosecutable 
offenses. Navy personnel policy makes it unlikely that a corpsman prosecuted for a serious offense 
would have been retained and promoted, much less recommended by his command for IDT training. 
Therefore, coding the frequency rather than the degree of discipline problems was considered to 
provide one estimate of performance consistency. A second estimate of performance consistency 
included the frequency of substandard performance evaluation. 

The number of instances of substandard performance was chosen rather than the cumulative number 
of each substandard mark given, or the average of actual marks across a man's entire career, for 
several reasons. First, obtaining mean performance scores across an entire career would be time- 
consuming, and therefore impractical for the Navy to use in conjunction with an applicant screening 
procedure. Second, using a single mean of all career performance scores ignores fluctuating trends 
that would reflect inconsistent or unreliable performance (Hunter & Hunter, 1984). Third, use of a 
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cumulative count of substandard marks versus instances of marks could under- or overestimate trends 
in performance based on the possibility that the number of categories (scores) chosen by a 
reporting senior to reflect substandard performance might be somewhat arbitrary. Therefore, both 
cross-career averages and cumulative counts of each substandard mark are less efficient estimators 
of consistent performance than counting the number of significant instances of poor performance in 
terms of one or more substandard mark per report. 

The Navy converts performance evaluation scores to a 10-point system descending from 4.0 to 2.6 
in incrementSs^of .2, with two additional categories of 2*0 and l.i3. Marks are assigned to a variety 
of performance dimensions on a yearly basis, and whenever an individual is transferred to a new 
command. Although a mark of 2.8 is considered unsatisfactory by the Navy, it is not customary to 
grade senior enlisted personnel below 3.4 except for serious dereliction or disciplinary infraction. 
This might be because special administrative justification is required for such grades 
(NAVMILPERSINST 1616. lA of 10 MAY 1983). Marks below 3.0 are most commonly associated with a 
disciplinary censure, such as nonjudicial punishment, relief for cause, a pending administrative 
dismissal, or a court martial. Therefore, anytime a performance mark of 3.0 or lower was 
encountered for a single reporting period, that period was coded as one instance of substandard 
performance. 

Job Experience . Each duty assignment documented in the corpsman*s service record was coded in 
two major respects — the context in which the assignment occurred, and the type of duties 
performed. Assignment context was categorized as either ship, hospital, clinic, school, field, or 
"other." Types of duties were categorized as either clinical, administrative, teaching, equipment 
operator/lab duties, or "other." Only post-boot-camp active-duty assignments excluding duty 
under instruction were included. Assignments for duty under instruction ("DUINS") were included as 
a training variable. Although both the number of tours and duration of tours in months were coded, 
the number of tours was dropped because of the excessive degree of statistical dependency (i.e., the 
two types of information were highly redundant) . The number of months was chosen because it 
demonstrated greater variance. 

Coding job experience data according to context and type of duty required judgment calls in 
approximately 20% of instances. This was usually because the narrative remarks from early career 
performance evaluations were no longer in the service record. These earlier evaluations are 
routinely removed by the Naval Military Personnel Command in order to reduce record storage 
requirements. However, the information is summarized on the "Enlisted Performance Record" (Page 9) 
of the service record, in the form of five primary evaluation marks, date, reason for report, and 
name of command. 

Ambiguities encountered in the coding of assignment contexts and duty types were systematically 
addressed by cross-checking information on the various types of records, especially the ''Navy 
Occupational Training and Awards History" (Page 4), "Transfers and Receipts" (Page 12), and 
"Administrative Remarks" (Page 13) . Other documents which provided concurrent situational clues 

were also taken into account. A coding scheme was developed to classify assignments for which no 
additional duty information other than context was available. This scheme was based on information 
suggested by senior corpsmen attached to NHRC, and is presented in Appendix B. 
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Qual i tati ve Factors . information of a qualitative nature was coded to explore possible 
failure-related factors that might not be adequately measured using quantitative variables alone. 
The primary sources of information were the performance evaluation narratives written by commanding 
officers during the shipboard tour in question. The remarks of inspection teams were also 
considered. These remarks are normally entered into the service record when a relief action is 
involved. Occasionallyr written rebuttals by the corpsman appeared in the record, and these were 
taken into consideration insofar as such remarks might have helped to clarify the causal factor that 
led to job failure. These remarks were not used to determine whether or not the relief was 
justified. 

In addition to recording the reason (s) for relief and any criticisms about the corpsman 's 
administrative ability or medical judgment, the occurrence of any reference to overweight, marital, 
or prior health problems was noted. 

Pre-Relief Job Perf ormance Marks . In order to examine downward performance trends that might 
signal job failure, five primary performance factor marks were encoded from the period around the 
time of job failure. This time period included the time of performance- related relief (or the 
latest report for 1983 in the case of controls) and the three reports prior to that evaluation, 
excluding reports pertaining to duty under instruction. This span of time was considered most 
likely to indicate levels of performance causally related, in a temporal sense, to job failure. 
Marks assigned while in training status were excluded primarily because the Navy believes them to be 
unreliable from school-to-school (NAVMILPERSMAN JAN 1985) • 

The five performance factor marks were general performance, reliability, flexibility, 
leadership, and conduct. Differences in reporting formats for performance evaluations were taken 
into account to insure comparability regardless of form used during the time period.^ All marks 
were transformed into a 10-point metric descending from 4.0 used by the Naval Military Personnel 
Command (Robertson, Royle, and James 1973). 

Analyses 

Data analyses examined three distinct periods: Before entering IDT school, after entering IDT 
school, and after reporting for shipboard IDT duty. Data analyses were organized according to the 
four research objectives stated in the background section. 

The first set of analyses examined the period after reporting for IDT duty. They were designed 
to meet the first study objective: To describe the prevalence and causes of job failure based on 
performance-related relief data obtained for 1982 and 1983. The second set of analyses examined 
the period prior to entering IDT school in order to identify possible screening criteria derived 
from background factors significantly related to IDT job failures (Objective II) . The third set of 
analyses examined the period after entering IDT school. These analyses tried to determine whether a 
change either training standards or assignment criteria might be warranted on the basis of a 
relationship between class standing in IDT school and job failure (Objective III). Finally, the 
fourth set of analyses also examined the period subsequent to reporting for shipboard duty. It 
consisted of an examination of performance trends leading up to job failure in order to determine if 
early intervention might be possible (Objective IV) . 
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Objective I: Prevalence and Causes of Job Failure . The prevalence of job failures among Fleet 

IDT corpsmen was estimated by tabulating personnel transfer data for IDTs during a two-year period 

ending in 1983. These data were provided by the Enlisted Personnel Manpower Analysis Center, New 

Orleans. The number of job failure cases was divided by 389, the approximate number of shipboard 

IDT billets in the 1982-1983 time frame as published in the annual Force Summary of the Naval 
4 

Review. 

Analysis of the causes for IDT job failure began with a classification of the reasons 
stipulated in the narrative remarks in the service record. These remarks were most often in the 
periodic performance evaluations. Narrative descriptions were summarized and sorted using a 
conceptual clustering strategy (Q-sort; Gough & Woodworth, 1960; Block, 1961) in order to identify 
categories of causal factors. 

Objective II: Screening Criteria . Identification of potential screening criteria consisted 
of a 1-way multivariate analysis of variance (MANOVA) to test overall multivariate differences 
between the effective ai^d job-failure corpsmen on four categories of pre-selection background 
variables: (a) contexts of prior assignments (e.g., ship, clinic, etc.), (b) types of duty (e.g., 
administrative, clinical, etc.) during prior assignments, (c) performance history (e.g., negative 
evaluations, awards, etc.), and (d) job training (i.e., total HM training, and number of "C" schools 
attended) . This procedure established whether significant reduction in the number of job failures 
might be possible through improved applicant screening. Post-hoc tests consisted of four discrete 
MDAs, computed for each pre-selection background category (Specter, 1977). 

Finally, in searching for potential screening variables, researchers normally strive to 
identify factors that not only significantly distinguish between successful and unsuccessful 
applicants, but that account for a substantial amount of of between-group variance (Barker & Barker, 
1984). However, in the present case, a great deal of between-group variance has already been 
exhausted through a) current selection procedures already in use, as well as b) career attrition 
caused by selective promotion. Therefore, any significant between-group variance discovered in this 
study, even though small, would be likely to improve screening of IDT training applicants. 

Objective III; Training and Assignment Criteria. Evidence of a significant relationship 
between job failure and classroom achievement would justify consideration of using class standing 
as a qualification or an assignment criterion. However, because there are costs associated with 
both screening and assignment, the amount of predictive variance unique to class standing will be 
examined through use of MDA. 

If a significant increment in job failure prediction could be accomplished over and above the 
prediction provided by improvements in pre-training screening, it would suggest that enhancement of 
IDT effectiveness could best be accomplished by both the expansion of screening criteria, as well as 
basing assignment decisions on demonstrated mastery of IDT skills and knowledge during training. 

Objective IV s Performance Trends. Three performance evaluations leading up to the time of 
job failure were analyzed in order to determine whether the causal process resulting in job failure 
involved progressive performance deterioration over many months or occurred in a relatively brief 
span of time. 

Multivariate discriminant analysis (MDA) was used to contrast the effective and job-failure 
groups, and to examine, as predictor variables, average performance marks assigned for the three 
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successive periods prior to job failure. Performance marks assigned at the time of job failure were 
excluded because, at that point, the prediction question is moot. It would be expected that 
performance marks assigned to effective corpsmen would show no significant change across the three 
targeted periods. Therefore, with respect to ineffective corpsmen, a significant multivariate 
solution that exhibited a trend of increasing weights over time (3-prior to 2-prior to 1-prior) 
would reflect a progressive process of performance deterioration. If the univariate mean score 
differences also were shown to be significant 1 or even 2 evaluations prior to relief, this would 
imply that potential job failures could be identified perhaps 12 or more months before the initia- 
tion of a personnel action to relieve from duty. 

Finally, in order to determine which specific aspect of IDT job performance was most strongly 
associated with actual job failure, the five discrete grades at the time of relief from duty were 
also subjected to discriminant analysis. 

RESULTS 

Objective I: Prevalence and Causes of Job Failure 

Prevalence of IDT Job Failure . Given the operational definition of job failure as a 

performance-related relief which could be verified in the service record, a conservative estimate of 
the occurrence of job failure in the Fleet based on reliefs during 1982 and 1983 was about 5% per 
year, most of these (69%) occurred during the first year of duty. This was based on a ratio of an 
average 18.5 failures per year to approximately 389 Fleet billets'^ covering the period 1982 and 
1983. The 37 failures were nearly equally distributed over the two year time frame (Appendix C) . 

It might be speculated that a 5% annual failure rate is too conservative in that some IDT 
corpsmen possibly avoided job failure by seeking early relief for medical conditions, humanitarian 
reasons, or non-reenlistment. Therefore, a more liberal estimate was derived from data provided by 
the Enlisted Personnel Manpower Analysis Center on all shipboard IDT unprogrammed reliefs during the 
target period. 

Excluding administrative transfers due to outstanding performance (e.g., selection for warrant 
officer training), there were 17 medical transfers (including 5 transfers for alcohol rehabilitation 
excluded from the current study because no performance decrement was mentioned in their service 
records), 5 humanitarian transfers, and 10 failures to re-enlist. If the assumption was made that 
as many as half of these were motivated by fear of job failure, then a liberal estimate of the 
number of IDT corpsmen experiencing significant performance problems might approach 7% annually. 

Causes For Failure . Table 4 presents the descriptive breakdown of recorded reasons why IDT 
corpsmen underwent performance-related reliefs. Three major categories of reasons were summarized, 
each of nearly equal likelihood: (a) inspection failure, (b) disciplinary infraction, and (c> 
difficulties in getting along with the superiors. 
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Table 4 

Categorized Reasons for Job Failure Among Shipboard Independent Duty Corpsien 
Sampled for 1982 and 1983 

Category Reason SORFPAC SOBPftC SURFLMIT SOBLAHt 

INSPBCTIOH nkZUIRB 38» (14) 

Force Heaical Seadiness Insp. 

IMSORV Inspection Failure 
RBPTSA Failure 

DISCIPLIHAST IMFRACTIOH 32% (12) 

Substance Abuse-Related 
Criminal Behavior 



PROBLEMS DEALING NITH SUPERIORS 31% (11) 

Loss of Command Confidence 
Inability to deal with CO/XO 



t 










JML 






(7) 


(I) 


(5) 


U) 


27% 


(10) 


(5) 


(1) 


(3) 


(1) 


8% 


( 3) 


(1) 


(0) 


(2) 


(0) 


3% 


( 1) 


(1) 


(0) 


(0) 


(0) 






(6) 


(2) 


(3) 


(1) 


19% 


( 7) 


(4) 


(1) 


(2) 


(0) 


13% 


( 5) 


(2) 


(1) 


(1) 


(1) 






(5) 


(2) 


(2) 


(2) 


16% 


( 6) 


(1) 


(1) 


(2) 


(2) 


14% 


( 5) 


(4) 


(1) 


(0) 


(0) 






18 


5 


10 


4 



100% (37) 



Inspection failure accounted for the highest proportion of job failures. Disciplinary 
infractions ccmiprised the second most-coa«non factor leading to relief. More than half the 
disciplinary infractions were substance abuse related. This included not only personal drug and/or 
alcohol abuse, but also serious irregularities in accounting for controlled substances that might or 
might not have involved drug use by the corpsman in question. A second irregularity involved 
falsification of urine screening on behalf of fellow crewmen. Criminal behavior included acts such 
as check forgery and disturbing the peace. 

Lastly, a slightly smaller, but still considerable, percentage of corpsmen experienced an 
inability to deal effectively with their COs and/or XOs. These IDTs became involved in conflicts 
with their superiors, and their inflexibility resulted in actions to have them removed. In nearly 
half of these cases. Force medical inspection team visits were requested by the command, and these 
inspections often uncovered deficiencies. However, these cases were coded as "problems with 
superiors" because, in comparison with descriptions of cases coded as being precipitated by routine 
inspection, it was apparent that the command called the inspection primarily due to erosion of 
command confidence or as a disciplinary measure. 

Objective II: Screening Criteria 

Demographics . It is unlikely that background characteristics of a demographic nature should be 
related to job effectiveness among a group as homogeneous as IDT corpsmen. As the sample 
descriptions in Tables 1 and 2 indicated, only one demographic characteristic showed evidence of a 
significant between-group difference. Effective and job-failure IDT corpsmen did not differ in age, 
race, marital status, amount or source of Navy Medical training, aptitude, or time as a corpsman 
(mean time for both groups was 14 years; F(l) = 2.30, [ns]). They did, however, differ in that job 
failures tended to be more junior in rank at time of reporting for IDT duty aboard ship during the 
target period. 

Although rank was significantly associated with job failure, screening applicants on the basis 
of rank would appear to be impractical. The distribution of rank among IDTs was shown by Nice 
(1984) to be approximately 50% first-class petty officers (E-6) and 50% chief petty officers (E-7) . 
The 50/50 distribution of rank was further supported by the rank distribution of the control sample 
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for this study. Both results implied that a large percentage of E-B personnel are currently 
required in order to fill existing billet requirements* Consequently, it would seem more 
appropriate to consider rank in the context of the assignment process rather than to use it as a 
selection variable for screening applicants. 

Career Background . A series of analyses addressed identification of "pre-selection" career 
background variables that might significantly improve personnel screening. Results of these 
analyses indicated that when examining job experience, amount of job training, and performance 
history, only performance history was significantly related to job effectiveness. 

The first stage of the analyses involved an overall test of multivariate between-group 
significance using a 1-way multivariate analysis of variance (MANOVA) of all the predictor variables 
considered. A significant MANOVA solution was established using Hotelling's test: T^«0,38, 
"^mult ^^^'^^^ ~ 1-38; £<.04. This result justified more focused analyses to identify the specific 
variables which most accounted for between-group differences. As suggested by Spector (1977) , 
follow-up results were based on post-hoc MDAs examining separately job experience (duty context, 
duty type), job training, and performance history. 

Job Experience . Table 5 presents results of the separate MDAs run on the two categories of job 
experience. Type and context of duty each failed to reach multivariate significance in 
distinguishing between groups. 

Table 5 

Discriminant Analyses of Pre-IDT-School Differences Between Job Failures and 
Effective (Controls) Independent Duty Corpsmen Based on Type and Context of Prior 
Duty Assignments 



Pre-IDT School 

Type of Duty Controls Discr. Job Failures 1-Way 

Mean Mos. Wts Mean Mos, F-Test Sig, 



Clinical Care 


24.7 


.37 


28.0 




.7 [ns] 


Administrative 


40.7 


-.06 


39.8 




.0 [ns] 


Lab/Tech 


5.4 


-.66 


8.6 




1.0 [ns] 


Teaching 


3.7 


.40 


1.3 




1.9 [ns] 


E i g n^lllllllilll^^ • 0 5 , 




X^(4,N»83) 


- 4.74 


£<.32 


[ns] 


Context of Duty 












Hospi tal 


27.9 


-.14 


26.2 




.0 [ns] 


Clinic 


4.3 


.42 


6.5 




.7 [ns] 


Shipboard^ 


13.9 


.19 


15.9 




.5 [ns] 


Field (Marine) 


5.9 


.83 


10.9 




5.1 £<.02 


School Staff 


3.0 


-.14 


2.3 




1.9 [ns] 


Eignenvalue = .06, 




(5,N=93) 


= 5.77 


£<.33 


[ns] 



^ Includes all ship's company experience and underway experience 
with Marine division aboard amphibious assault ships. 
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Training & Performance History , Table 6 presents the separate MDAs on pre-IDT school 
training exposure and performance history. Simultaneous entry of variables was 
employed. Although training and awards failed to reach multivariate significance, 
number of substandard evaluations significantly distinguished between effective and 
job- failure IDTs, accounting for 7% of between^group variance. The distribution 
across force and fleet of the number of substandard evaluations is displayed in 
Appendix D. 

Table 6 

Discriminant Analyses of Pre-IDT-School Differences Between Job Failures and Effective 
(Controls) Independent Duty Corpsmen Based on Training and Performance History 



Training 

Number "C" Schools 



Controls 
Mean 



1.1 



Pre-IDT School 

Discr. Job Failures l-Way 
Wts Mean F-Test Sig, 



Months HM Training 8.1 



.61 



.14 



0.9 
8.7 



0.7 



0.3 



Ins] 
[ns] 



Bignenvalue « .02, Rc**^^' X^(3,N=95) » 2.23 p<.33 [ns] 



Performance 
History 

Number Sub- 
Standard Evals^ 

Number of Awards 9.7 
Number of NJPs 



1.4 .80 2.2 14.4 £<.000 

-.41 7.9 3.8 [ns] 

0.3 .29 0.6 1.9 [ns] 



Bignenvalue « .08, R^=.27, Bta^=.07, X^(3,N«95) = 7.16 £<.05 
^ Number of evaluations with one or more grades of 3.0 or less. 



The question remains as to whether or not discriminant validity accounting for only 7% of 
between group differences is sufficiently high to justify expansion of IDT corpsman applicant 
screening criteria. Schmidt, Hunter, McKenzie and Muldrow (1979) underscored the practical utility 
of a very small increment in prediction in accounting for substantial improvements in personnel 

decision-making. Using tables developed by Taylor and Russell (1939), it was possible to estimate 
the practical improvement in job effectiveness screening represented by a multivariate Eta^ of .07. 
Entry into the tables required both an estimation of the Navy's current selection ratio for 
shipboard duty (about 50%, as mentioned earlier) , and the current job failure rate for shipboard 
IDTs (between 5 and 7%). 

Based on the Taylor and Russell tables, the estimated improvement derived from screening 
applicants on instances of substandard performance could potentially reduce the 7% estimated failure 
rate to 4.5%: A 39% reduction in job failure from 28 to 17 per year. in the case of the 5% 
estimated failure rate, this means a drop to 3%, which represents about a 40% reduction in job 
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failures from 18.5 to 11.1 job failures per year. These results, therefore, support expansion of 
current screening criteria to reduce the number of fleet IDT job failures. 



Objective III: Training and Assignment Criteria 

A simple cross-tabulation of class standing determined that 79% of job failures were in the 
bottom half of their class; 52% in the bottom quarter. The correlation between job failure and 
class quarter at time of graduation from IDT training was found to be r=.24, which was significant 
at the .01 level. This result suggested that, in addition to significant prediction of job failure 
by incidences of substandard performance prior to selection for IDT training, job failure might also 
be predicted on the basis of classroom achievement. 

The question remains, however, whether applicant screening, assignment based on academic 
performance, or both warrant consideration as possible strategies to reduce the incidence of job 
failure. One way of determining the answer to that question was to see if class standing could 
substantially increase prediction of job failure beyond that possible by instances of substandard 
job performance. The two nonsignificant perfprmance history variables, NJPs and awards were dropped 
due to nonsigni f icance, and class standing was added after instances of substandard performance. 

Table 7 provides information on whether class standing (the assignment variable candidate) 
added substantively to between-group prediction over and above prediction by instances of 
substandard performance (the screening variable candidate). Results indicated that, when comparing 
the equation without class standing (MDA Step I) to that containing class standing (MDA Step II) , 
the addition of class standing improved prediction significantly (£<.01). This also raised the 
Eta^ to .10, indicating an increase in between group prediction from 7% (using substandard 
performance alone) to 10%. 

Table 7 

Discriminant Analyses of Pre- and Post- IDT-School Differences Between Job Failures and 
Effective (Controls) Independent Duty Corpsmen, Forcing Class Standing Ahead of Substandard 
Performance 

Controls Discr. Job Failures 1-Way Wilks' Lambda Sig. of 

Select variables Mean Weights Mean F-Test Sig. After Entry Increase 

Pre & Post-IDT School 

Number Sub- 1.2 .80 2.2 6.0 £<.02 .9322 (Step 1) -NA- 
Standard Evals^ 

IDT Class Standing 3.1 .74 2.6 5.2 £<.03 .8985 (Step 2) £<.01 
(Class Qtr) 

Eigenvalue = .11, R^=.32, Eta^ = .10, X^(2,N=85) = 8.8 £<.01 

^ Number of evaluations with one or more grades less than 3.2. 
Fourth quarter is the highest; first quarter is lowest. 

In order to determine the degree of independent predictive variance possessed by class standing 
alone, a second MDA was run reversing the order of variable entry . independently, class standing 
accounted for 6% of between-group variance (indicated by a Wilks* Lambda of .9412). This was both 
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statistically significant (£<.03), substantively meaningful. The decrease in Wilks' Lambda at Step 

II was almost identical: .04 when adding substandard performance second, versus .03 when entering 

it first. This suggested that the degree of overlap in total predictive variance for both 

substandard performance and class quarter was substantial. Each variable independently predicts 

group differences to the same degree, and to the same extent, each adds significant prediction when 

combined with the other. 

Finally, although the Eta^ increased significantly to .10, when assignment based on class 

quarter was added as a predictor (Table 7), it was still necessary to determine if the estimated 

practical improvement in screening using both variables improved substantially. Using the Taylor 

and Russell tables, the estimated percent of improvement in screening out potential job failures 
2 

signified by an Eta of .10 remained unchanged at 39% for the 7% failure rate, and 40% for the more 
conservative 5% failure rate. 

This result seems to provoke a dilemma. On one hand, addition of a second predictor (either 
substandard performance - screening, or class standing - assignmient) significantly improved between- 
group prediction, yet on the other hand, this improvement was insufficient to permit an estimable 
improvement in screening job failures. At first blush, such a result would seem to demonstrate an 
almost equal "practical" ability to reduce the incidence of job failure in the fleet. However, this 
result may merely indicate a type of ceiling effect. Because the remaining percentage of failures 
left unexplained by either substandard performance or class standing stands at only 3%, it is 
possible that even a significant increment in between-group prediction of 3 to 4% using both 
variables simply cannot be estimated when the rate of job failure approaches zero. Consequently, in 
a practical sense, it might prove to be of utility to incorporate both strategies using both 
variables. 

Objective IV: Performance Trends 

Table 8 presents the results of- an MDA run on the mean performance marks given for the three 
periods prior to a performance-related relief or, in the case of controls, the three evaluation 
periods prior to their due-course relief or November 1983, whichever was later. Inspection of the 
multivariate discriminant weights presented in Table 8 indicates that, relative to controls, there 
was a significant, monotonic, downward trend in performance among job-failure IDT corpsmen. This 
trend was evidenced by the smallest between-group difference occurring at three reports prior to 
relief, and the greatest difference one report prior to relief. These results established the 
existence of a progressive deterioration of performance preceding a job failure. 

The three mean performance measures were entered into a multivariate discriminant analysis, 
both hierarchically adcording to time and simultaneously. The results using either procedure were 
the same. It is noteworthy that even three reports prior to relief, representing a median period of 
2.3 years, there was a significant univariate performance mark difference between the groups. 
Consequently, it would appear that significant performance decrements do occur well prior to a 
performance-related relief. 

Table 8 also presents a follow-up MDA on the performance marks given at time of performance- 
related relief (due course, or last 1983 evaluation, for controls) . Because "performance" is an 
overview evaluation mark, it certainly will be related to more discrete ratings. Theoretically, 
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Table 8 

A Multivariate Comparison of the Mean Performance Marks for Job Failures 
and Effective (Controls) IDT Corpsmen 
Sampled for 1982 and 1983 



Discriminant Analysis 
Mean Overall Performance Prior to Relief^ 
Job Failures Wts Controls One-way F-Tests 

1 Report Prior 3.58 .96 3.91 F(94) =30.44, £<.000 

2 Reports Prior 3.74 .57 3.89 F(95) =10.60, £<.002 

3 Reports Prior 3.76 .53 3.88 F(95) = 9.14, £<.003 

Canonical R = .51, Eta^=.26, (3,N=95) = 27.8, £<.0000 

Overall Percentage of Cases Correctly Classified = 77% 



Discriminant Analysis 
Mean Performance Ratings At Time of Relief 
Job Failures Wts Controls One-way F-Tests 



^. .000 

£<.000 

p< . 000 

£<.000 
£<.000 



Pziioxmancz 


2. 


.51 


,90 


3. 


.9/ 


F(95J 


-123. 


'0, 


Reliability 


2. 


.40 


.88 


3. 


.87 


F(95) 


=117. 


.5, 


Flexibility 


2. 


.78 


.84 


3. 


.90 


F(95) 


= 107. 


.6, 


Leadership 


2. 


.90 


.63 


3. 


.87 


F(95) 


= 61. 


.3, 


Conduct 


3. 


.21 


.45 


3, 


.96 


F(95) 


= 31. 


.3, 



Canonical R = .81^ Eta^=.66, (3,N=95) = 82.8^ £<.0000 

Overall Percentage of Cases Correctly Classified = 95% 
Correlation between Performance & Reliability r = .90 



The average derived from three evaluations prior to performance 
related relief as IDT, or for controls, three evaluations prior t 
their last marks for 1983. 
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the discrete performance marks additively comprise overall performance. Nevertheless, performance 
was kept in the equation in order to control for its "halo effect" in affecting the other marks. 
Consequently, in this analysis, it is not the size of the mean scores that are of interest, but the 
size of the weights (overlooking the one for performance) . Both reliability and flexibility were 
shoim to be the most inportant perfomance factors for distinguishing between the effective and job- 
failure corpsman groups. 

The analysis of performance at the time of relief was conducted to determine in which area(s) 
corpsmen were viewed as being most deficient. Although this analysis failed to identify a 
convenient single area in which corpsmen were most deficient, it did demonstrate that leadership 
and conduct were viewed by commanding officers as less related to corpsman effectiveness than were 
reliability and flexibility. 

DISCUSSION OF RESULTS 

Objective I: Prevalence • and Causes of Job Failure 

Prevalence of IDT Job Failure . The derivation of an accurate estimate of the prevalence of job 
failure among shipboard IDT corpsmen was not straightforward. Definitional problems complicated 
identification of job failures. Even settling on a population comprised of performance-related 
reliefs led to other case identification problems. The identification of personnel who had been 
formally relieved for cause, required a case by case search through the files at the Enlisted 
Quality Control Review Board, and these files only went back about 20 months. Invariably, each 
command and force providing identification of possible performance-related reliefs had to base their 
nominations on recollections, and informal lists or collections of lists. Consequently, the 
prevalence of job failure among shipboard IDT corpsmen still remains a "rough estimate" between 5 
and 7%. 

The seriousness of a 5 to 7% annual failure rate warrants comment. A "ball park" estimate of 
turnover is provided by the Bureau of National Affairs (1980) . The Bureau estimated annual turnover 
in the health care professions generally to be about 25%. Across all industries, the Bureau 
estimated an average annual turnover rate of 24%. Such turnover rates are not uncommon in the 
organizational behavior research literature. However, these rates only include people who leave the 
organization (as opposed to leaving only their job) , people who leave voluntarily as well as 
involuntarily, and new hires as well as those with considerable organizational tenure. 
Consequently, determination of an accurate nationwide estimate to compare to the mid-career, blue 
collar, IDT corpsman job failure population is not possible. 

Actual determination of seriousness is dependent on associated costs with respect to financial 
losses, morale, and health risks. Financial costs include primarily the expense of providing a 
trained replacement for each job failure. Morale costs relate mainly to the negative impact on the 
image of Fleet medical care, as well as the negative impact on morale among the crews involved. 
Finally, health risks include both increased possibility of administrative oversights such as late 
physicals or missed immunizations, as well as more immediate risks arising from poor clinical 
judgment or improper treatment. Each of these costs must be weighed relative to options available 
to reduce the incidence of job failure. 
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Finally, it must be recalled that the prevalence of job failure reported in this study was 
determined on the basis of nonclinical criteria. That is, performance had deteriorated to a point 
requiring relief by the commanding officer. Commanding officers are only equipped to evaluate 
administrative and military knowledge, judgment, and performance unless confronted with a obvious 
case of malpractice. Most shipbbard medical department inspections do not address clinical 
knowledge, judgment or ability. Even Force Medical Department inspections, which are likely to 
occur only once or twice during the tour of a typical IDT corpsman, have tended to emphasize 
clerical matters such as record-keeping, supplies, and periodic medical reports. Without further 
study, it is not possible to determine the extent to which administrative incompetence relates to 
clinical incompetence. 

Causes of Job Failure . The present data cannot determine with certainty the extent to which 
lack of fleet, force, shore, and/or command support contributed to job failure, nor the extent to 
which a lack of managerial ability, task knowledge, or maturity led to any specific instance of 
corpsman ineffectiveness. Nevertheless, this report does present data that sheds additional light 
on the causal role of several major factors: (a) ccHnmand support, (b) demographic background and (c) 
maturity. 

The causal role of command support is unclear, although it appears to be a critical factor 
related to corpsman effectiveness. The current data cannot indicate whether lack of command support 
caused corpsman job failure, or deficiencies in the corpsman led ultimately to lost command support. 
The data reported in Table 4 showed, however, that a loss of command confidence directly or 
indirectly accounted for 16% of job failures. However, because the causal relationship was 
indeterminate, it is only possible to conclude that command confidence appears to be related to job 
effectiveness . 

With respect to demographic background, including both aptitude and age, the data in Table 1 
also reflect little difference between effective and ineffective corpsmen. However, a significant 

difference was found for rank at time of reporting aboard ship for IDT duty. E-6 (First-Class Petty 
Officers) corpsmen were more likely to undergo job failures than were E-7s (Chief Petty Officers). 
Because there were no differences between time- in-grade and years of service between E-6s and E-7s, 
it would appear that E-6 job failures had careers that were progressing at a slower pace than their 
E-7 counterparts. 

An additional factor that should be considered is that most reliefs occurred among first-tour 
IDTs. It is possible that Chief Petty Officers experience more cooperation and/or Command support 
than do First-Class Petty Officers, and support is often most critical when trying to learn a new 
job. Although limiting IDT assignments to E-7s is not likely to be practical, it would seem to make 
sense to assign more-senior personnel to difficult assignments (such as to relieve unsuccessful 
IDTs, or to serve with larger crews) . 

Finally, immaturity seems to have been a possible causal factor in some cases. The data in 
Table 8 reflected that many ineffective corpsmen were rated by their commands as being inflexible 
and unreliable. Both inflexibility and unreliability are traits associated with immaturity. In 
addition, disciplinary problems represented 32% of job failures, and ineffectiveness in dealing with 
superiors accounted for another 30%. For a mid-career petty officer to engage in substance abuse or 
criminal activity reflects, among other things, immaturity. Likewise, ineffectiveness in dealing 
with superiors, in some cases, can likely be traced to immaturity. 
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Objective II: Screening Criteria 

Training . With respect to training background, data presented in Table 1 and Appendix A 
indicated that effective and ineffective corpsmen did not differ significantly with respect to the 
number of "C schools attended, the total number of months spent in corpsman training, nor the 
levels of educational achievement. Therefore, with respect to job training, all things, at the time 
of applying for IDT training, seem to be equal. 

Job Experience and Performance History. The analyses presented in Tables 1 and 5 indicated 
that effective and ineffective corpanen did not differ in amount of job experience, types of duty 
assignments, or the contexts in which that duty occurred. However, the analyses presented on Tables 
5 and 6 indicated that consistent quality of performance (i.e., instances of substandard performance 
across one's career), not the type of task or the context of that performance, was what 
differentiated effective IDT corpsmen from job failures. 

With respect to performance history, the quality of a corpsman' s past performance prior to 
selection for school has been demonstrated in this study to predict job failure. Therefore, 
institution of expanded applicant screening seems warranted. Current Navy personnel selection 
policy limits examination of IDT applicant performance history to only the most recent three year 
period. The results of this study would seem to support expansion of personnel selection criteria 
to cover the entire period of an applicant's career, and exclusion of applicants with several 
instances (3 or more) of substandard performance (marks of 3.0 or lower) • 

In addition to expansion of selection standards, a more rigorous applicant review process 
might potentially extend screening accuracy beyond estimates reported here by taking into 
consideration not only performance history, but also impressions of maturity and other traits 
required in an operational shipboard environment. An applicant review board similar to that 
currently used in selection of officer candidates could be restructured to include several medical 
representatives in addition to operational line representatives. Another possible solution might be 
to develop and institute a battery of selection tests designed to screen applicants on job-relevant 
attributes. 

Objective III: Training and Assignment Criteria 

Class Standing . The relationship found in this study between job failure and class quarter 
would seem to suggest that, the effectiveness issue is not one of training content, but of training 
criteria. The training criteria problem can be dealt with in at least two ways. The first method 
consists of placing greater responsibility on training commands to raise standards through holding 
IDT trainees to a higher standard of demonstrable skill mastery. A second option, would be to 
assign only top trainees to shipboard duty upon graduation. 

Current IDT trainee assignment policy is based solely on sea-shore tour rotation cycles. The 
Naval Personnel system requires a lead time of six or more months to execute shipboard assignments. 
This requires issuance of orders without regard to trainee performance. Moreover, adherence to a 
standard sea-shore rotation cycle results in about 50% of non-submarine force IDT graduates (NEC- 
8425) being assigned to shore duty versus the sea duty for which they have just been trained. 
Consequently, delay of assignment until near completion of training and/or assigning all successful 
IDT trainees to sea would require reorganization of some personnel procedures. 
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One caveat must be raised • The amount o£ prediction of job failure demonstrated by class 
quarter was nearly the same as that for substandard performance history (c. 40%) . This raises the 
question as to whether it would be better to screen applicants on the basis of prior performance or 
to screen graduates by basing assignments on classroom achievement. 

Selection Versus A s signment . Results established that both pre-training selection, based on 
total career substandard performance evaluations, and post-training assignment, based on IDT 
training achievement, showed a nearly equal potential capability of reducing the incidence of IDT 
job failure. This fact raises the question of whether one or the other, or both methods should be 
considered for implementation. 

It is true that in a statistical sense, IDT class quarter was shown to add significantly to 
the prediction of job failure. However, the additional 3% increase in prediction over and above 
that already predictable by substandard performance was estimated to be insufficient to screen out 
additional job failures. This is because it takes a considerable increase in between-group 
predictive power to achieve substantial improvements in screening job failures as the percentage of 
those failures approaches zero. 

The least costly approach would be to screen applicants by excluding corpsmen who lack a 
history of consistent quality performance. Such an approach would save the expense associated with 
a permanent change of station, as well as training costs. There is, however, an additional relevant 
consideration. Historically, the staffing needs of the Navy have required occasional waivers of 
selection or assignment standards in order to respond to unforeseen contingencies. Because the 
additional cost of implementing both strategies examined here is relatively moderate, modification 
of both selection and assignment procedures would help to maintain actual reductions in job failure 
at approximately the 40% level estimated by the results of this report. 

Table 9 presents an actual breakdown of the subjects in this study by both criteria variables. 
Table 9 demonstrates that by screening out applicants with 3 or more instances of substandard per- 
formance, 32% of the job failure sample would have been excluded. Moreover, the cost associated 
with this modification of assignment policy is likely to be modest. This is to be contrasted with 
the effects of assigning to shipboard duty only those who graduated in the top three quarters of 
their class. With this strategy, 55% of job failures would have been excluded, however 28% of 
controls (non job- failures) would also have been excluded. 

Objective IV: Performance Trends 

One major source of Force Medical support is the medical readiness inspection. Failure of 
Force Medical readiness administrative inspections accounted for 28% of job failures and 70% of all 
the inspection failures that resulted in relief from duty. Each Force provides technical assistance 
to corpsmen when it is requested. Interviews with the Force Medical Master Chiefs conducted during 
1984 indicated that requests for assistance due to inspection failures frequently uncovered problems 
that had evolved to such a point that job failure could not be prevented. This raises the question 
of why corpsmen fail to initiate requests for help early enough to avoid job failure. 
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Table 9 

Tabular Summary of Instances of Substandard Performance and IDT Training Class Quarter 



Broken Down by Job Failures and Effective (Controls) Corpsman ^ 



Substandard Performance IDT Class Standing 





Job Failures 


Controls 






Job Failures 


Controls 


None 


27% 




52% 


1st 


Qtr 


15% 


26% 


1 


27% 




22% 


2nd 


Qtr 


6% 


18% 


2 


14% 




12% 


3rd 


Qtr 


27% 


28% 


3 


. » 14% 


.» 


5% 


4th 


Qtr 


52% 


28% 


4 


6% 


• 
• 


3% 










5 


! 8% 


• 
• 


2% 










6 


32% 


14% 


2% 










7 


2% 


• 
• 


2% 











8 

9 . » 2% .» 

^ Dashed lines and bold figures indicate 

Number of evaluations with one or more 



point of maximal screening and minimal error, 
grades less than 3.2. 



Corpsmen who fail to request technical assistance from Force Medical Departments, when it is 
required, may be insensitive to their owti deteriorating performance, or perhaps they are too proud 
to seek help. Sensitivity to one*s own performance can be improved through increased monitoring and 
feedback. However, the pride issue relates to immaturity, which is unlikely to change as a result 
of on-the-job intervention. Table 8 demonstrated that it is possible to identify deterioration in 
performance prior to job failure based on the Navy's annual enlisted performance evaluation. 
Therefore, if internal monitoring by corpsmen is insufficient to detect that the job is becoming 
unmanageable, for whatever reason, it might be useful to increase the amount of external monitoring 
(supervision) of corpsman effectiveness. 

Performance-Selated Relief: Post Script 

The present study has served to identify certain shortcomings in the way the Navy screens and 
assigns independent duty corpsmen based on a study of job failures. One question left unanswered 
concerns what became of these corpsmen. Personnel files were consulted as of March 1985, to 
determine the disposition of each of the 37 job failures studied. Three corpsmen had retired, 5 
more did not re-enlist, 20 had their NBCs converted (2 to 0000, 1 to 8294, 2 to 8407, and 15 to 
8404) and were re-assigned shore duty, whereas 9 (24%) retained their independent duty NEC. 

Of the nine corpsmen who retained their IDT NEC, 1 was reassigned to independent duty aboard a 
destroyer, 1 was assigned to an aircraft carrier, 2 were assigned to Marine units, 3 were assigned 
to hospitals or clinics, 1 was sent to a reserve center, and 1 was serving with a Naval Air 
Detachment. Of those whose NECs were changed, 1 was assigned to a submarine tender (8407), 10 were 
assigned to Marine units, 3 went to hospitals or clinics, 5 went to reserve centers, and one went to 
the military sea-lift command ashore. 

One conclusion that could be made on the basis of these post-relief data is that IDT job 
failure does not necessarily infer Navy job failure. In almost 80% of the cases, the corpsmen 
continued in the Naval service, albeit in a less responsible capacity. However, the question 
remains as to what percentage of the 9 corpsmen whose IDT NECs were not removed should have lost 
their IDT NECs except for lack of administrative follow-up. Furthermore, it is unclear what 
safeguards exist that would preclude reassignment of an IDT job failure to shipboard independent 
duty. 

Conclusions 

Considering the causes of job failure described in this report, it would seem cost effective 
both to expand applicant screening to include performance history and to modify current shipboard 
IDT assignment procedures to take academic achievement into consideration. 

The usefulness of increased medical supervision among Fleet units also seems justified in view 
of the results reported in this paper. Increased supervision might even help alleviate some of the 
pressure experienced by* successful IDTs by increasing the frequency of administrative feedback on 
medical readiness. Increased supervision would also help detect deteriorating performance, increase 
access to a broader base of medical skill and knowledge, and it might permit implementation of a 
formalized qualification and recertif ication program. The cost of increased supervision in terms of 
additional personnel at either the squadron or force level would likely be substantial. The 
potential benefits, in terms of increased quality of health service delivery Fleet-wide could be 
substantial as well. 
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Footnotes 

^Information was based on interviews conducted on three occasions during visits to NMPC during 

1984. 

2 

In March of 1984, a list of duty assignments for all graduates of the Advanced Hospital Corps 
School in San Diego was provided by HMCS Keen, DSN, Acting Director of Advanced Hospital Corps 
School. The period covered 18 months ending in January 1984. It reflected that slightly over 50% 
of graduates were ordered to shore duty assignments. 

^The five factors listed below are commonly used by Navy Military Personnel Command as a basis 
for making personnel decisions: 



Evaluation Form Box Numbers 
NAVPERS NAVPERS NAVPERS 



Factor : 


(792) 


(1616/8) 


(1616/ 


1. Conduct/Behavior 


08 


18 


32 


2. Leadership/Directing 


03 


21 


36 


3. Reliability 


07 


16 


30 


4. Flexibility/Potential 


06 


20 


29 


5. General Performance 


17 


13 


39 



Based on a figure derived from the reported Naval Force strength published in the Proceedings 
of the Naval Institute Annual Review for 1983 and 1984. 



30 



References 



Allport, G. W. (1942) . The use of personnel documents in psychological science. Social Scienc e 
Resear ch Council B u lletin , No. 49. 

Block # J. (1961) • The Q -sort method i n personality assessme nt and psychiatric research . 

Springfield, IL: Charles C. Thomas. " ~ 

Barker, H. R. and Barker, B. M.(1984). Multivariate analy sis of variance (MANOVA) : A practical 

guide to its use in scientific decision ma king . Mobile: University of Alabama Press. 

Bureau of National Affairs (1980). Job absence and turnover. Cited in R. T. Mowday, L. W. Porter, 
and R» H. Steers (1982) Employee-organization linkages: The psychology of commitment , 
absenteeism, and turnover. New York: Acad^ic Press, pp 108-109. 

Cohen J. (1977). Statistical po wer analysis for the be havi oral sciences . New York: Academic Press. 

Curtis, E. W. (1971). Pred iction of enlisted performance: 1. ■^"^'^"9 aptitude tests_^ 

Navy _ S c hool grades, _t h e r eport " of enlisted p erform a nce evaluation , " a"nd ad v ancement 

exa minations . (NPTRL Scientific Technical Bulletin ""No. 71-10). San Diego, CA: Naval Personnel 
and Training Research Laboratory. 

Dunnette, M. D. (1962). Personnel management. _ . . P sychology , 13 , 285-314. 

Dunnette, M. D. (1972) . Vali dity study results for jobs relevant to the petroleum refining 

industry . Washington, DC: The American Petroleum Institute. 

Gough, H. G. St Woodworth, D. G. (1960). Stylistic variations among professional research 

scientists. Journ al of Psychology , 49, 87-98. 

Harding, F. D., & Bottenberg, R. A. (1962). Effect of personal characteristics on relationships 
between attitudes and job performance. Journal of Applied Psy chology , 45 , 428-430. 

Hoiberg, A. (1981). Occ upational stress and illness inc idence. (NHRC Report No. 81-18). San Diego, 

CA: Naval Health Research Center. *" 

Holzbach, R. L. (1978). Rater bias in performance ratings: Superior, self- and peer ratings. 
Journal of App lied Psychology, 63 , 579-588. 

Hunter, J. E. (1980c) . Test validation for 12,000 j obs; An application of synthetic va lidity and 
val idity generalization of the General Aptitude Test Battery (GATBj . " WashingtonJ DC: U.S. 

Employment Service, U.S. Department of Labor. 

Hunter, J. E. and Hunter R. F. (1984). Validity and utility of alternative predictors of job 
performance. Psycho log ical Bulletin , 96 , 72-98. 

Lau, A. W« and Abrahams, N. M. (1970). The vocational interest inventory as a pre dictor o f job 
performance . (NPTRL Scientific Research "Report No. 70-28). San^Dlego, CA:~llavaV "Personnel and 
Training Research Laboratory. 

Miner, J. B. and Brewer, J. F. (1976). The management of ineffective performance. In M. D. 
Dunnette (Ed.) Handboo k of Industrial and Organizational Psychology^ Chicago: Rand McNally. 

Nice, D. S. (1984). vQy_ oA J^.^^y^^.^A^^^^ A"^ sea . (NHRC Report No. 

84-22).. San Diego, CA: Naval^Health Research Center. 

Owens, W. A. & Henry, E. R. (1966). Biographical data in industrial psychology: A revie w and 
ev aluation . Greensboro, NC: The Creatfv ity "Research Institute,' The Richardson Foundation. 

Owens, W. A. (1976). Background data. In M. D. Dunnette (Ed.) The handbook of indu stria l and 
organiz ationa l psyc hology . Chicago: Rand McNally. ~ " " 

Reilly, R. R. and Chao, G. T. (1982). Validity and fairness of some • alternative employee selection 
procedures. Perso nnel Psycho logy , 35 , 1-62, 

Robertson, D. W. (1972). Source documents for the automated enlisted performance evaluation system . 
(NPRTL Scientific Research Memorandlim" No." 7~2~-r0) . San^'Di'ego," CA: Naval Personnel ^Training 
Research Laboratory. 

Robertson, D. W. , Royle, M. H., and James, J. ( 19 73 ). 25_s_L'l!l_-H^S' Fleet trial of autom ated 

perform ance evaluation fo rms for 600 pay grade groups j_ _E5-E6 _.find_2El^4 "(NPRTL~"Sc ient i f ic 

Technical Bulletin~No7"73-rr)~.''~San Dfego, CA: "Naval Personnel Training "Research Laboratory. 

Schmidt, F. L. Hunter, J. E., McKenzie, R. C. and Muldrow, T. W. (1979)* Impact of valid selection 
procedures on work-force productivity. Jou rnal _Qf 3.P^PA\^_4 -^^^^^Q^^i.^* 64 , 609-626. 

Seaton, L^( 1983) . Federal medical chiefs on progress and plans: The Navy Medical Department. Mil itary 
Med icine, 148 , 841-844. 

Siegel, S. (1956). Nonparame tr ic S tatistics for the Behavioral Sci ences . New York: McGraw-Hill. 

Stanlee, L. S. and Abrahams, N. M. (1980). Scree ning of Marine Corps drill i nstru ctors. (NPRDC 
Report No. 80-17). San Diego, CA: Naval Personnel Research"and 'Development ^Center T"" 



31 



Spector, (1977). What to do with significant multivariate effects in multivariate analysis of 

variance. Journa l of Applied PsY^chqlog^^r 62 , 158-163. 

Taylor, H. C. and Russell, J. T. (1939). The relationship of validity coefficients to the practical 
effectiveness of tests in selection: Discussion and tables. Journal of Applied Psy ch ology , 23 , 
565-578. 

Thomas P. J, (1968). An analysi s of the Nav y enlisted perfo rmanc e evaluation system . (NPTRL 
Scientific Technical Bulletin No. 69-27. San Diego, CA: Naval Personnel Training Research 
Laboratory. 

Vinebecg, R. & Joyner, J. N. (1978). Per formance of men i n different mental categories; 2 

Assessment of performance in selected Navy jobs . [HumRRO Report No. 78-1). Alexandria, VA: 
Human "Resources Research OrganizatFonT " 

Vineberg, R. & Joyner, J. N. (1982). P£gjigtion of_job^ performance; Revi ew of tnilitary studies . 
(NPRDC TR 82-37). San Diego, CA: Naval Personnel Research and Development Center. 

Vineberg, R. & Joyner, J. N. (1983). Performance measurement in the military services. In F. Lany, 
S. Zedeck, and J Cleveland (Eds) Performanc e Measuremen t and Th eory. Hilsdale, NJ: Lawrence 
Erlbaum & Associates. 



32 



I 



i 



I 



Appendix A 

Breakdown b y .Grq uj) of the Me ans an d Sta ndard Devia t ions for the Major 
IPT-Co r psman Background Variables 





Job Failures 


Controls 




Variables 














Mean 


S.D. 


Mean 


S.D. 


T— test Sig. 


DEMOGRAPHICS: 












Age 


35.7 


3.5 


35.6 


3.2 


[ns] 


Times Married 


1.1 


0.7 


1.3 


0.7 


[nsl 


Number of Dependents 


2»3 


1.5 


2.2 


1.4 


[ns] 


Aptitude 


117.0 


10.4 


117.8 


11 .8 


[ns] 


Year Became Corpsman 


*69 


3.9 


'69 


3.3 


[nsl 


EDUCATION AND TRAINING: 












High School Graduate 


all 




all 






Years Since "A" School 


13.1 


3.9 


14.2 


3.3 


[nsj 


Number of Pre-IDT "C" Schools 


1.0 


0.8 


1.1 


0.8 


[nsj 


Total Months Pre-IDT HM Training 


8.7 


6.8 


8.1 


4.3 


[nsl 


Tear Graduated IDT School 


1^78 


3.1 


1977 


3.1 


[ns] 


JOB EXPERIENCE: 












Context of Duty : 












Ship of months) 


15.9 


18.4 


13.9 


20.6 


[nsl 


Hospital of months) 


26.2 


22.0 


27 .9 


24.1 


[nsl 


Clinic (# of months) 


6.5 


10.9 


4.3 


9.3 


[ns] 


School Staff of months) 


2.3 


9.9 


3.0 


9.8 


[nsl 


Field Medical of months) 


10 .9 


14 .5 


5 .9 


9.3 


[ns] 


Type of Duties: 












Clinical of months) 


28.0 


13.3 


24.7 


22.5 


[nsl 


Administrative of months) 


39.9 


28.3 


40.7 


30.3 


[nsl 


Teaching of months) 


1.3 


4.3 


3.7 


9.6 


[nsl 


Lab/Tech [ff of months) 


8 . 6 


20 8 


5 .4 


14 . 9 


[nsl 


Mi <5f ( a of months^ 


3.7 


9.7 


5.7 


11.3 


f nsl 


PERFORMANCE: 












Mean Marks of 3 Pre-Relief Reports: 












Conduct 


3.88 


0.2 


3.95 


0.1 


[nsl 


Leadership 


3.67 


0.3 


3.87 


0.1 


4.90 p<.006 


Reliability 


3.64 


0,3 


3.86 


0.2 


4.36 p<.006 


Flexibility 


3.67 


0.3 


3.91 


0.1 


5.79 p<.000 


General Performance 


3.66 


0.3 


3 .88 


0.2 


5.41 p<.000 


Number of Non-IDT-Tour NJPs 


0.6 


1.0 


0.3 


0.9 


[as] 


Number of Unauthorized 


0.3 


0.8 


0.1 


0.4 


Ins] 


Absences 












Number of Days Total 


1.1 


5.1 


0.1 


0.3 


[ns] 


Unauthorized Absence 












MISCBLLANBOUS: 


N 




N 






Overweight Mentioned 


2 " 










Marital Problems Mentioned 


0 




0 






Prior Health Problem(s) Mentioned 


0 




3 






Interservice Transfer 


4 




1 







Appendix B 

Coding Scheme For Classification Of Unspecified Type of Duty 



CONTEXT 



SITUATION 



DUTY TYPE CLASSIFICATION 



Hospital : Any 

Clinic: Any 

School : Non-Student 

Field: Vietnam 

Marine Air Wing 
Otherwise 

Ship: Hospital Ship 

Independent Duty 
Other Class Vessel 
Out-of-Rating 

Other : Out-of-Rating 
Otherwise 



Clinical 

Administrative 

Administrative 

Clinical 
"Other*' 

1/2 Clinical & 1/2 Admin. 
Clinical 

1/2 Clinical & 1/2 Admin, 

Administrative 

''Other" 

"Other" 

Administrative 



34 



Appendix C 

Breakdown of the Number of Reliefs by Force and Fleet 





Year 


1 


Year 


2 






PAC 


LAMl 




T A XTm 




SURF 


6 


6 


12 


4 


28 


SUB 


2 


3 


3 


1 


9 




8 


9 


15 


5 


37 

• 
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Appendix D 

Number of Job Failure Pre-IDT School Substandard Evalu a tions 
Broken Down By Force and Fleet 



# of Sub- 
standard 
Evaluations 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 + 



SURFPAC SUBPAC SURPLANT SUBLANT 



3 
8 
1 
4 
1 



3 
1 
2 
1 



2 
1 



18 



10 
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job failure was based on analysis of service record entries. Identification of 
ways to prevent/reduce job failures focused on three methods: applicant 
screening, post-training job assignment, and on-the-job remedial assistance. 
Potential screening and assignment criteria were identified by examining four 
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problems in dealing effectively with superiors (30%). Expansion of current 
screening criteria could be justified on the basis of job-failure IDT corpsmen 
exhibiting significantly more pre-application instances of substandard perfor- 
mance and fewer instances of outstanding performance. Modification of assign- 
ment procedures could be justified on the basis of significant prediction of 
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